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ABSTRACT 



This paper describes the possible effects of feedback on 
learning (associations) using a connectionist tool, the delta rule. Feedback 
in instruction can be described in terms of the interaction of stimulus 
inputs and response outputs, an associationist perspective. Here the delta 
rule is applied to each instance that an input and an output likely interact; 
the delta rule is used to describe the direction and magnitude of increase or 
inhibition of each instance. The total effect for a type of feedback is then 
described by the combination of the instances that make up that type. The 
findings of this investigation may provide seminal foundations for 
understanding feedback effects. The paper focuses on the following topics: an 
overview of the connectionist approach; implications of lesson item 
difficulty; delta rule calculations for immediate and delayed feedback; and 
implications. Several graphs and mathematical calculations illustrate the 
discussion. (Author/AEF) 
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Abstract 
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This paper describes the possible effects of feedback on learning (associations) using a 
connectionist tool, the delta rule. Feedback in instruction can be described in terms of the 
interaction of stimulus iiqjuts and response outputs, an associationist perspective. Here the delta 
rule is applied to each instance that an input and an output likely interact; the delta rule is used to 
describe the direction and magnitude of increase or inhibition of each instance. The total effect 
for a 'type' of feedback is then described by the combination of the instances that make up that 
type. The findings of this investigation may provide seminal foimdations for understanding 
feedback effects. 



Focus of this Paper 

This presentation will focus on: 

■ Overview of the Connectionist approach 

■ Implications of lesson item difficulty 

■ Delta rule calculations for immediate and delayed feedback 

■ Implications 



"PERMISSION TO REPRODUCE THIS 
MATERIAL HAS BEEN GRANTED BY 

R. B. Clariana 



TO THE EDUCATIONAL RESOURCES 
INFORMATION CENTER (ERIC).” 

Connectionist Approach 

Recently, connectionist investigations have revived associationist views of memory. 
Connectionist apply various mathematical rules within neural network computer simulations in a 
search to mimic and describe memory associations and learning. For example, trained neural nets 
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have been shown to be capable of pattern matching, recognition, and classification (Haberlandt, 
1997) among other things. This approach provides additional ways to understand cognitive 
activity (McClelland & Rumelhart, 1985). 

Among a number of connectionist rules, the delta rule (Shanks, 1995; Widrow & Hoff, 
1960) is one of the simplest that include the effects of feedback on learning. The delta rule 
describes the change in association weight, termed Aw, between an input unit and an output unit 
at each learning trial, as Awio = a a^ (to - aout), where a is the learning rate parameter, au, is the 
activation level of input units, to is the desired response (the t refers to 'teacher', in this case to is 
item feedback), and aout is the activation level of the output units (from Shanks, 1995). 

In instructional terms, learning is an increase in the association (e.g., an increase in Awio) 
between the stimulus (am) and the correct response (aout), with a relative decrease in association 
(e.g., a decrease in Awio) for incorrect responses. For example, suppose you move to a new city; 
for the question "What is your postal zip code?", your old zip code at that instance will have a 
probability of being recalled of say .53, while your new zip code would have a probability of .24 
(refer to Figure 1). Over time, the old will decrease (if it is not recollected) while the new 
increases. Note that the two are separate but probably correlated units. Interference (RI and PI) 
and also retrieval competition between the two is likely, and so context of recall is important. 




Figure 1 . Two visualizations of output activation levels (possible responses) of about 100 output 
units aout given an input activation am (such as a lesson question). Activation levels, regardless of 
absolute activity, are shown as proportions which sum to 1. 
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In the delta rule equation, feedback impacts learning in the term (to - aom). Customarily, 
the values for to and aom are constrained between zero to one (McLeod, Plunkett, & Rolls, 1998). 
The value for to equals one if the activation level of the input unit matches the desired response 
(i.e., with correct responses) and to equals zero if the activation level of the input unit does not 
match the desired response (i.e., with incorrect responses). So with correct responses the 
association weight increases since (1 - aom) is positive, while with incorrect responses the 
association weight decreases since (0 - aom) is negative. 

Item Difficulty and Feedback Effects 

Though not yet a part of the feedback canon, feedback probably has its greatest effect 
with difficult lesson items. For example, Bangert-Drowns, Kulik, Kulik, and Morgan (1991) 
state: 

If feedback's primary importance is the correction of errors, then One would expect to 
see larger effects for instruction with higher error rates (more difficult lessons). This is 
exactly what happens. The correlation between error rate and effect size is .48, a 
significant relation. (p.230) 

So feedback is most effective with difficult lessons. Lesson item difficulty and number of lesson 
errors reflect the same construct, so it is a small step to state that feedback is most effective with 
difficult lessons items . (Note: Have previous studies of feedback been confounded by lesson 
difficulty?) 

To apply the delta rule, lesson average item difficvilty values are assumed to be 
reasonable estimates of initial lesson aout- Item difficulty is a simple item statistic obtained by 
averaging correct responses to an item, for example an item difficulty of .20 indicates that 20% 
of the learners responded correctly to that item. Item difficulty values range from 0 to 1 with 
low values indicating difficult items and high values indicating easy items. Using lesson average 
item difficulty values as estimates of lesson a«ut seems justified in that lesson average item 
difficulty is the actual averaged probability of selecting the correct answer for that hern during 
the lesson for that popvilation of learners. 
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Using the Delta Rule to Predict Feedback Effects (posttest performance) 

Assumptions 

In conparing immediate and delayed feedback, first the delta rule would predict that for 
correct lesson responses, memory of both initial lesson responses (ILRs) and of correct responses 
(CRs) would be strengthened in general for both immediate and delayed feedback, since to = 1 
and so (to - aout) is positive. Second, for incorrect lesson ILRs (i.e., errors), the ILR association 
with the item stem would be weakened for immediate feedback since to = 0 and (to - aout) is 
negative, but not for delayed feedback. Note further that the delta rule can predict both 
magnitude and direction of the post-feedback memory association levels of ILRs for immediate 
and delayed feedback as well as for correct responses. The results of applying the delta rule 
across a range of possible lesson item difficulty values are shown below in detail. 

The delta rule (Shanks, 1995) estimates change in association weight (Awio) as a result of 
feedback training as Awio = a am (to - aout). The retention test association weight of a'out can be 
estimated as a'out = aout + Awio (the prime symbol in this paper indicates retention posttest values 
of the variable, while variables without a prime symbol are lesson values). In order to perform 
delta rule calculations, it is necessary to estimate two item related variables in the equation, a the 
learning rate parameter, and am, the activity level of the input unit (in this case the question 
stem). The term a ranges from 0 to 1 , and most likely relates to the femiliarity of the content 
domain and the form of the question. In this case, a will be set equal to 0.5, the mid-point, as the 
best-guess estimate. The term am also ranges from 0 to 1 . Hopefully, the vocabulary of item 
stems as well as their relationship to the lesson text make items meaningfiil and vmderstandable, 
with a resulting average a,n nearly equal to 1 . In this case ai„ will be set equal to 0.8. (Note: 
Future studies may attempt to directly measure am by asking learners to self-report the 
meaningfulness of each item.) Both a and am for an item combine to impact the change in 
association weight in the delta rule. In this study a * am = 0.5 * 0.8, so in the calculations to 
follow, a * ain = 0.4. 

For any item labeled g, lesson item difficulty value gg provides a measure of the lesson 
activation level of item g. To solve for retention test a'out for any lesson pg, substitute pg for 
lesson aout in the delta rule and substitute 0.4 as an estimate of a ain: 

n out ~ Pg 0.4 (to - Pg) 1 
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This approach shown in Equation 1 can be applied across a range of possible lesson item 
difficulty values providing retention test activation levels of both ELRs and of correct responses 
for both delayed and immediate feedback. 

Predicting ILR Posttest Values for Immediate Feedback 

When correct, to = 1 and so the activation weight of the initial 
lesson response is increased per the delta rule: 

p'lLR-C “ Pg + 0-4 (1 - Pg) 2 

When the lesson response is incorrect estimate the activation level of the 
ILR using Equation 3, then since to = 0 decrease the activation level of the 
ILR per the delta rule: 

PiLR-I = (1 - Pg) 3 

p'lLR-I = PiLR-I + 0.4 (0 - PiLR-l) ^ 

Now combine Equations 2 and 4 (see Figure 2): 

p'lLR = (Pg * P'lLR-c) + [(1- Pg ) * P'lLR-I ] 5 




Lesson Item Difficulty pg 

Figure 2 . Graph of the Predicted ILR Posttest Values for Immediate Feedback. 
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Note that the correct and incorrect items contribute to final predicted retention test p'ilr 
proportionally across different values of pg. For example, when pg = 0.3 (a difficult item with 
30% of the learners getting it right and 70% missing it during the lesson), p'ilr-c in Equation 2 
contributes 0.3 and p'ilr.i in Equation 4 contributes 0.7 to the total p'ilr score. Equation 5 shows 
this proportional combination of p'ilrc and p'ilr.i relative to the item difficulty pg. 

Predicting ILR Posttest Values for Delayed Feedback 

When correct, the ILR association increases with the initial 
commitment per the delta in Equation 6, then since to = 1 the ILR increases 
during the presentation of feedback per the delta rule in Equation 7: 

PlLR.C = Pg + 0.4(l -pg) 6 

p'lLR.C = PILR.C + 0.4 (1 - PlLR.c) ^ 

When the lesson response is incorrect, first estimate the activation level of 
the ILR using Equation 8, then since to = 1 increase the activation level of 
the ILR per the delta rule: 

PiLR-I = (1 - Pg) 8 

p'lLR-I = PiLR-I + 0.4 (1 - PiLR-l) 9 

Now combine Equations 7 and 9 (see Figure 3): 

p'ilr = (Pg * P'lLR.c) + [(1- Pg ) * P'lLR-I ] 10 



In the steps shown in Equations 6 and 7, delayed feedback receives two positive 
increments based on the assumption that both the initial response and then the feedback response 
constitute two separate learning exposures. Note especially in Equation 9 that to = 1 rather than 0 
since the learner presumes that their initial response is correct. Conq)aring the curves shovvn by 
Equation 5 in Figure 2 and Equation 10 in Figure 3 indicates that posttest memory of ILRs will 
be considerably larger imder delayed feedback compared to immediate feedback. 
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Lesson Item Difficulty pg 

Figure 3 . Graph of Predicted ILR Posttest Values for Delayed Feedback. 

Predicting CR Posttest Values for Immediate Feedback 

When correct, to = 1 and so the activation weight of the correct 
response is increased per the delta rule: 

p'cR-c = Pg + 0.4(l -Pg) 11 

When incorrect, estimate the initial error activation level pilr-i in terms of 
Pg using Equation 12, next use this value of Pdlr-i to deter min e the final 
activation level of the error pW-i, since to = 0, the error association 
decreases (Equation 13), then determine the adjusted value of pcR-i in terms 
of p'lLR-i using Equation 14, then determine p'cR-i fi’om pcR-i using Equation 
15 with to = 1: 



Pdlr-i = (1 -Pg) 


12 


P'dLR-I = pILR-I + 0.4 (0 - piLR-l) 


13 


PCR-I = (1 - P'lLR-l) 


14 


P'CR-I “ PCR-I + 0.4 (1 - PcR-l) 


15 



Now combine Equations 1 1 and 15 (see Figure 4): 
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P'cR ” (pg * P'cR-c) + [(1- Pg ) * P'cR-I ] 16 

With immediate feedback, the ILR error interacts with attaining the correct response. 
Specifically, the delta rule change at Equation 13 results in a decrease in the ILR error 
association, which increases the activation (relative) of the correct response in Equation 14, and 
then the delta rule change at Equation 15 results in a second absolute (not just relative) increase 
in the correct response association. This results in the odd situation that for any given item with 
difficulty pg, posttest gain will be greater when it is missed during the lesson (per equation 15) 
than when it is correct during the lesson (per Equation 11) mainly due to the error decrease in 
Equation 13. 




Lesson Item Difficulty pg 

Figure 4 . Graph of the Predicted CR Posttest Values for Immediate Feedback. 

Predicting CR Posttest Values for Delayed Feedback 

When correct, the correct response association increases with the initial commitment per 
the delta in Equation 17, then since to = 1 the correct response increases again during the 
presentation of feedback per the delta rule in Equation 18: 
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PcR-c = Pg + 0.4(l -pg) 17 

p'cR-C = PCR-C + 0.4 (1 - pcR-c) 

When the lesson response is incorrect, since to = 1, increase the activation 
level of the correct response per the delta rule: 

p'cR-i = Pg + 0.4(l -Pg) 19 

Proportional combination of Equations 18 and 19: 

p'cR = (Pg * p'cR-c) + [(1 - Pg ) * P'CR-I ] 20 

In Equations 17 and 18, we again follow the assumption that delayed feedback gains two 
delta increases due to the double exposure to the items. When the lesson response is incorrect^ to 
= 1 rather than to = 0 (see discussion above). 




Lesson Item Difficulty pg 

Figure 5 . Graph of the Predicted CR Posttest Values for Delayed Feedback. 

Implications 

The different predicted effects for immediate and delayed feedback for posttest memory 
of ILRs and CRs are displayed below together (see Figure 6). These calculations suggest several 
hypotheses. First, the most noticeable difference is observed between the immediate and delayed 



Mathematical explanation of feedback ... 10 



feedback predicted posttest values of ILR (Equations 5 & 10). Students receiving delayed 
feedback should remember their initial lesson responses (both when an error and when correct) 
much better than those students receiving immediate feedback. Next, for posttest CRs, both 
immediate and delayed feedback have the greatest effects for more difficult lesson items. Last, 
comparing posttest CRs, immediate feedback may be slightly better than delayed feedback 
(Equations 16 versus 20) with more difficult items, while delayed feedback is slightly better with 
the easier items. 




Lesson Item Difficulty pg 

Figure 6 . Composite graph of the Predicted Posttest Values for each feedback treatment 
(IF - Immediate feedback; DF - Delayed Feedback). 

These three hypotheses should be examined experimentally. Fmther, these findings 
suggest that previous investigations comparing immediate and delayed feedback may be 
confovmded by the difficulty of the lesson materials. Previous studies of feedback timing should 
be reexamined in terms of lesson difficulty. 

Can a connectionist approach accoxmt for feedback effects on memory and learning? The 
preceding descriptions are likely neither completely right or wrong. In several equations, it was 
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necessary to make a decision that the association would work one way or another way. 

Hopefully, we guessed right most of the time. Either way, this paper places a stake in the grotmd 
that can be adjusted with additional thought. 
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